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Abstract 

This paper provides a new formulation of second order stochastic target problems 
introduced in [22] by modifying the reference probability so as to allow for different 
scales. This new ingredient enables us to prove a dual formulation of the target problem 
as the supremum of the solutions of standard backward stochastic differential equations. 
In particular, in the Markov case, the dual problem is known to be connected to a fully 
nonlinear, parabolic partial differential equation and this connection can be viewed as 
a stochastic representation for all nonlinear, scalar, second order, parabolic equations 
with a convex Hessian dependence. 
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1 Introduction 



The connection between the backward stochastic differential equations (BSDE hereafter) 
and the nonlinear, parabolic partial differential equations (PDE hereafter) is well docu- 
mented. Indeed the standard BSDEs, as introduced by Pardoux and Peng [TB], are known 
to provide a stochastic representation for the solutions of semi-linear PDEs in the Markov 
case. In this representation, the diffusion coefficient of the underlying process is the linear 
coefficient of the Hessian variable in the PDE. Therefore the connection to fully nonlin- 
ear equations require an extension that should allow for stochastic processes with different 
diffusion coefficients. Indeed, [7] develops such a generalization to the second order and 
also proves a Markovian uniqueness result in an appropriate class. However, no existence 
theory is available for this generalization with the one exception in the Markov context. In 
this case any smooth solution of the related PDE, if exists, is easily seen to be a solution 
of the second order BSDE. A closely related class of control problems, called second order 
stochastic target problem was introduced in [22] as well. 

In this paper, we provide a new formulation for the second order stochastic target 
problems. A better understanding of the target problem is essential for a coherent theory 
of second order BSDEs. Indeed, we develop this theory in our accompanying work [25] 
including existence and uniqueness results with minimal assumptions. 

We continue with the description of the target problem. Let B be a Brownian motion 
under the probability measure Po and {J~t,t > 0} be the corresponding filtration. For a 
continuous semimartingale Z, we denote by V the density of its covariation with B. We 
then define the controlled process Y by, 

Y t :=y- f H s {Y s ,Z s ,F s )ds + I Z s odB s , d(Z, B) t = T t dt, (1.1) 
Jo Jo 

where o denotes the Fisk-Stratonovich stochastic integration. We assume that the given 

random nonlinear function H satisfies the standard Lipschitz and measurability conditions. 

Then, for any reasonable process Z and an initial condition y, a unique solution, which is 

denoted by Y v,z , exists. We now fix a time horizon, say T = 1, and a class of admissible 

controls Z°. Then, given an Ti measurable random variable £, [22] defines the second order 

stochastic target problem by, 

V° := inf jy : Y?' Z > £ P -a.s. for some Z G 2°} . (1.2) 

In this formulation, the structure of the set of admissible controls is crucial. In fact, if 
Z° is not properly defined, then the dependence of the problem on the variable T can be 
trivialized. We refer to [3] for a detailed discussion of this issue in a particular example of 
mathematical finance. One of the achievements of the approach given below is to avoid this 
strong dependence on the control set and simply to work with standard spaces. 
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As in many optimization problems, convex duality results provide a deeper understand- 
ing and powerful technical tools. Indeed, they are an essential step for the well-posedness of 
the second order backward stochastic differential equations, as proved in our accompanying 
paper [25]. Motivated by these, we adopt a new point of view for the target problems which 
also allows for the construction of the dual. This new formulation differs from that of [22] 
in two instances. First, we re-inforce the constraint Y?' Z > £ in (jl.2p by requiring that 
it should hold under various mutually singular measures and not only on the support of 
Po- Secondly, the set of admissible controls utilized here is more natural and, as discussed 
above, it avoids the technical aspects of [22J. 

Our reformulation is motivated by the work of Denis and Martini [8] on the deep theory 
of quasi-sure stochastic analysis. An important related probabilistic notion, introduced by 
Peng [19j, is the G-Brownian motion. Here instead of using these two powerful tools, we 
employ a direct approach by assuming sufficient regularity. One drawback of all these ap- 
proaches is the implicit regularity assumption. Indeed, in all these approaches, integrability 
in any power is possible only if the random variable is quasi-surely continuous. This is 
a Lusin type of result and is not restrictive when there is only countably many measures. 
However, in general, this is an additional constraint. In one of our accompanying paper [23] , 
we provide an alternative approach through aggregation of random variables. The general 
aggregation result of [23J allows us to consider a larger class of random variables but then 
the class of probability measures must be slightly restricted. 

We believe our approach has several advantages. 

- It avoids to redevelop an appropriate theory of stochastic integration from scratch, as 
it is done in [8] and [T§] . 

- More importantly, a representation theorem is available in our framework as proved 
in [21]. 

- Finally, by deriving appropriate estimates, it is shown in [25J that one can extend 
these concepts to a larger space with regularity conditions. Indeed a similar extension of 
G-martingales is given in [9] showing that they cover the same space as in the quasi-sure 
analysis of [8]. 

We next provide an intuitive description of our formulation. For this heuristic explana- 
tion we assume a Markov structure. Namely we assume that H in (jl.ip and £ in (|1.2|) are 
given by 

H t (y,z, 7 ) = h(t,X t ,y,z, 7 ), £ = g(X T ), (1.3) 

where dXt = dBt and h, g are deterministic scalar functions. Let V°(t,x) be defined as in 
(jl.2p with time origin at t and Xt = x. As it is usual, we assume that 7 1— > h(t, x, y, z, 7) 
is non-decreasing. Then, by an appropriate choice of admissible controls Z, it is shown in 
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|22| that this problem is a viscosity solution of the corresponding dynamic programming 
equation, 

— — — h (t, x, u(t, x), Du(t, x), D 2 u(t, x)) = 0, u(l,x)=g(x). (1.4) 
We further assume that 7 t-> h(t, x,r,p, 7) is convex. Then, 

h(t,x,r,p,j) = supi -aj - f (t,x,r,p,a)\ , (1.5) 
a>0 1 1 ) 

where / is the (partial) convex conjugate of h with respect to 7. Let Df be the domain of 
/ as a function of a. By the classical maximum principle of parabolic differential equations, 
we expect that, for every a £ Df, the solution u > u a , where u solves (|1.4p and u a is defined 
as the solution of the following semi-linear PDE, 

du 1 

- -Tjj; ~ -aD 2 u(t,x) + f (t,x,u(t,x),Du(t,x),a) = 0, u(l, x) = g(x). (1.6) 
In turn, by standard results, u a (t,x) = Y t a , where, for s € [t,T], 

X a s =x+i a y 2 dB r , Y s a = g(X%) - f{r : X^,Y^Z a r ,a)dr- j Z?a 1/2 dB s . (1.7) 

Jt Js Jt 

We have formally argued that V°(i, x) > Yf 1 for any a £ Df. Let A$ is the collection of 
all processes with values in Df. By extending (jl.7p to processes a, it is then natural to 
consider the problem 

V t := supY t a , (1.8) 



as the dual of the primal stochastic target problem. Indeed, the optimization problem (jl.8p 
corresponds to the dual formulation of the second order target problem in the Markov case. 
Such a duality relation was suggested in the specific example of [21] and can be proved 
rigorously by showing that v(t,x) := Vj is a viscosity solution of the fully nonlinear PDE 
(jl.4p . This, by uniqueness, implies that v = V ■ Of course, such an argument requires some 
technical conditions at least to guarantee that comparison of viscosity supersolutions and 
subsolutions holds true for the PDE (jl.4p . 

The main object of this paper is to provide a purely probabilistic proof of this duality 
result. Moreover, our duality result does not require to restrict the problem to the Markov 
framework. 

We should mention that we use weak formulation in our approach, that is, instead of 
controlling the state process X a in (jl.7p , our control is the distribution of X a on its canonical 
space. See (|2.3p below for the precise definition. Such weak formulation is important for 
modeling model uncertainty, as in [8] and |19j . In the contexts of stochastic control, which 
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naturally uses strong formulation, some ideas have already appeared in the literature, see 
e.g. El Karoui and Quenez and Peng |18| . In particular, [18] uses the notion of r.c.p.d. 
which turns out to be crucial in our approach. 

This paper is organized as follows. After introducing the probabilistic structures in 
the next section, we provide the definition of the stochastic target problem in Section [3j 
Two relaxations, which are also shown to be equivalent to the original problem, are also 
introduced in that section. The main duality result is stated and proved in the following 
section. Section [5] is devoted to a weaker formulation. An extension is outlined in the next 
section and in the Appendix we provide the proofs of two technical results. 

2 The set up 

Let Q := {lo E C([0, 1], R ) : ojq = 0} be the canonical space equipped with the uniform norm 
IMloo := su Po<t<i l w *l> B the canonical process, Po the Wiener measure, F := {Jj}o<ki 
the filtration generated by B, and F + := {J 7 ^ , < t < 1} the right limit of F. 

We say a probability measure P is a local martingale measure if the canonical process B 
is a local martingale under P. By Follmer [12] (see also Karandikar [13] for a more general 
result), there exists an F— progressively measurable process, denoted as J * B s dB s , which 
coincides with the Ito's integral, P— a.s. for all local martingale measures P. In particular, 
this provides a pathwise definition of 

(B) t := B t Bj - 2 I B s dBj and a t := E5 - ({B) t - (B) t - e ) , 
J elO e v / 

where T denotes the transposition, and the lim is taken componentwise and pointwise in lo. 
Clearly, (B) coincides with the P— quadratic variation of B, P— a.s. for all local martingale 
measures P. 

Let Vw denote the set of all local martingale measures P such that 

(B) t is absolutely continuous in t and a takes values in P — a.s. (2.1) 

where denotes the space of all d x d real valued positive definite matrices. We note that, 
for different Pi,P2 € Vw, in general Pi and P2 are mutually singular. For any P £ Vw, it 
follows from the Levy characterization that the Ito's stochastic integral under P 

Wf := f a~ 1/2 dB s , te[0,l], P-a.s. (2.2) 
J 

defines a P— Brownian motion. As in |23] . we abuse the terminology of Denis and Martini 
[8] as follows 

Definition 2.1 For any subset V C Vw; we sa U a property holds V- quasi- surely (V-q.s. 
for short) if it holds F-a.s. for allFsV. 
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In this paper we concentrate on the subclass V s C V\y consisting of all probability 
measures 

P a := P o (X*)- 1 where X? := f a l J 2 dB s , t G [0, 1], P - a.s. (2.3) 

Jo 

for some F— progressively measurable process a taking values in with \at\dt < oo, 
Po— a.s. We recall from [23j that 

P s |p ' Vw -.W^ T j . (2.4) 



where F (resp. ¥ wF ) is the P- augmentation of the filtration generated by B (resp. by 
W ¥ ). Moreover, 

every P £ Po satisfies the Blumenthal zero-one law 

(2.5) 

and the martingale representation property. 

Notice that an F-progressively measurable process can be viewed as a mapping from 
[0, T] x f! to R . Moreover, X a takes values in Q and thus its canonical space is also and 
the canonical filtration is still F. We have the following simple lemma. 

Lemma 2.2 Let a be an ¥ -progressively measurable process taking values in with 
Jq \att\dt < oo, Po— a.s. Then there exists an ¥ -progressively measurable mapping (3 a : 
[0, T] x O ->• R d such that 

B = !3 a (X a ), P - a.s. and W r = /3 a {B), a(B) = ao (3 a (B), dtx¥ a - a.s.. 



Proof. First, by [23] Lemma 8.1, we know F^ a = ¥ B , and in particular, B is F^ Q 
progressively measurable. By [23] Lemma 2.4 and Remark 12.31 below, there exists an F^"- 
progressively measurable process B such that B = B, Po-a.s. Then, by viewing Q as the 
canonical space of X a , one may identify the process B as an F-progressively measurable 
mapping f3 a . Changing back to the canonical space of B and noting that X a takes values 
in f2, we have B[oS) = /3 a (X a (ui)) for all u; G fi, and therefore, B = f3 a {X a ), Po-a.s. 
Now it follows from the definition of P a that 

B,W a ) =(x a ,B) where W a := p a (B), (2.6) 



i.e. the F a - distribution of (B,W a ) is equal to the P -distribution of (X a ,B). Note that 
d(B) t = a t {B)dt, P Q -a.s. and d{X a ) t = a(B)dt = ao (3 a (X a )dt, P -a.s. Then 

B, W a , a(B)) = (x a , B,ao p a (X a ) 
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This implies that a{B) = a o f3 a (B), dt x W a — a.s.. Moreover, since dB t = a~ 1/2 {B)dX? = 
a; 1/2 {(3(X a ))dX?, Po-a.s.. it follows from $2J2) that 



Remark 2.3 In the standard stochastic analysis literature, the theory is developed under 

the augmented filtration. Because we are working under mutually singular measures, unless 

otherwise stated, we shall use the filtration F. We recall from [23] that, for every probability 
— p 

measure P, every F -progressively measurable process X has an F-progressively measurable 
version X, i.e. X = X, P— a.s. Therefore, given P, all processes involved in this paper will 
be considered in their F-version. However, notice that such a version may depend on P. See 
also Remark 13.61 below. 

Moreover, following similar arguments, the above result still holds true if we replace 
F by an arbitrary filtration. In the proof of Lemma 12.21 we have used the result on the 



Finally we clarify that by the statement "X = X, P-a.s." we mean that these processes are 
equal dt x c?P-a.s.. When both of them are cadlag, clearly Xt = Xt, < t < 1, P-a.s.. 

3 Second Order Target Problem and Relaxations 

In this section, we start with the definitions and assumptions related to the nonlinearity H 
and its convex dual. Several spaces used in the paper are also introduced in subsection 13. II 
We then give the definition of the original problem, two relaxed problems and the dual. We 
provide an easy first string of inequalities in the final subsection. 

3.1 Definitions and Assumptions 

Let H t (oj,y,z,~/) : [0,1] x $7 x M x R. d x Djj — > R be F— progressively measurable, where 
Da C M. dxd is a given subset containing 0. We assume throughout that 

Assumption 3.1 For all oj € £1, H is Lipschitz continuous in (y,z), uniformly in (t,u,^) 
and it is uniformly continuous in oj under the L 00 — norm. Moreover, we assume that it is 
lower- semicontinuous in 7 and the conjugate F defined at (|3.ip below is measurable. 

In the sequel, we denote by A : B := Tt[A t B] for A,B £ R dxn . We introduce the 
conjugate of H with respect to 7 by: 




□ 



filtration F 



•A" 



□ 




sup 




(3.1) 
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We notice that F is measurable if H is upper-semicontinuous (and hence continuous) in 7 
or if Dh is compact, see e.g. [2j. Moreover, since H is uniformly continuous in (oj, y, z), the 
domain of F as a function of a is independent of (oj,y,z). Thus we denote it by Dp t . By 
the uniform Lipschitz continuity of H in (y, z), we know that 



F(-,a) is uniformly Lipschitz continuous in (y, z) and uniformly continuous in oj, 



(3.2) 



uniformly on (t, a), for every a E Dp t . 
Moreover, for our duality result of Section [H we need to further assume that 
Assumption 3.2 There is a constant C such that, for all (t, oj, y, Z\, Z2) and all a E Dp t : 



F t (u,y,zi,a) - F t (oj,y,z 2 ,a) 



< C 



a 1/2 (zi - z 2 ) 



We also define 



F t (y,z) :=F t (y,z,a t ), and if := F t (0, 0). 



(3.3) 



In order to focus on our main idea, in this section we shall restrict the probability measures 
in a subset Vh C V '5 defined below. We will extend our results to more general cases, as 
well as allowing H to take value 00, in Section [6] below. 



Definition 3.3 Let Vh denote the collection of all those P £ Vs such that 

a P < d < ap, dt x cflP — a.s. for some a P ,ap € 
-1 



and 







+ H. 



0|2 



< 00. 



(3.4) 
(3.5) 



Remark 3.4 In our accompanying paper [25] we consider a slightly more general class V H 
with a parameter k £ (1,2]. The Vh in this paper coincides with the case k = 2 there. All 
the results in this paper can be easily extended to the general case k € (1, 2]. In particular, 
Theorem 14.51 and Proposition 14. 101 in this paper still hold true for general k, which are used 
in [251 Theorem 4.6. □ 



It is clear that dj E Dp t , dt x dP-a.s. for all P E Vh, and by (|3.2p together with 
Assumption [ 



|F t (yi,zi) - F t (y 2 ,z 2 )\ < C(\ yi - y 2 \ + \a t /2 ( Zl - z 2 )\), dt x dP-a.s. for all P E 7>#. (3.6) 



Remark 3.5 The Lipschitz continuity in z in (|3.6p is implied by the following condition 
on H: 

I 1 /2 I 

\H t (y,z 1 ,j) - Ht(y,z 2 ,j)\ < C\a t ' (zi - z 2 )\, dt x cflP - a.s. 
for some constant C which does not depend on (t,u,y, 7). □ 
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We conclude this subsection by introducing the spaces which will be needed for the 
formulation of the second order target problems. For any domain D in an Euclidian space 
with appropriate dimension, let L°(Z?) denote the space of all J 7 ! -measurable random vari- 
ables taking values in D, and M°(D) the space of all F + -progressively measurable processes 
taking values in D. Notice that here we use the right limit filtration F + . For any P G Vw, 
let B°(P, D) the subspace of E°(D) whose elements have cadlag paths, P-a.s.; I°(P, D) the 
subspace of ID> (P, D) whose elements K have nondecreasing paths with Kq = 0, P-a.s.; and 
§°(P, D) the subspace of D°(P, D) whose elements have continuous paths, P-a.s. 

Moreover, let 

L 2 ( 



\D) := {eGL°p):EH|e| 2 ]<oo}, 



,D) := {H eU°(D) :E v [ti\H t \ 2 dt\ < oo}, 



} 2 {F,D) := 1 1" G D°(P, D) : E p sup 0<t<1 \Y t \ 2 



< oo 



}• 



(3.7) 



I 2 (P,D) : = 



, D) n I°(P, D), S 2 (P, D) := B 2 (P, D) n S°(P, D). 



and denote 



t 2 H (D) := P) L 2 (P,L>), M 2 H (D) := f] H 2 (P,L>), 
veV H PeP/f 
and the corresponding subsets of cadlag, continuous processes, nondecreasing processes: 
■= Dpe^D^P,^), S 2 H (D) := np^S 2 ^,^), t 2 H (D) := f] Ve -p H I 2 (P, D). 
Finally, let 



m{D H )-= H g2 ( F > D h), and SM H (l 



,d\ 



n ^(ip,i 



where 



and SM 2 H (I 
Z with r G 



r € 



f(D H ) : ~a:r-il(0,0,r) G 



2 (P,P)}, 



C 



! (P, M. d ) is the space of all square integrable (P, F + )-semimartingales 



\D H ), where T is defined by d(Z,B) t = T t : d(B) t , P-a.s.. 



Remark 3.6 We emphasize that in the above spaces we require the processes to be F + - 
progressively measurable. This is important because the process V + in (I4.21|) is in general 
F + -progressively measurable. See also Proposition 14.111 and the paragraph before it. 

However, for fixed P G Vs, it follows from the Blumenthal zero-one law that E 18 ^)^] = 
E p [^|J-" t + ], P— a.s. for any t G [0,1] and P— integrable £. In particular, this shows that any 
J~^— measurable random variable has an Tt— measurable P— modification. Consequently, 
for any fixed P, we may view the processes in L 2 (P, D) as F-progressively measurable. □ 
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3.2 The second order target problem 

- — - 2 

For Z G SA4n(M. d ), it follows from Karandikar |13| that the Ito's stochastic integrals 



t rt 

Z s dB s and / B s dZ s are defined Vh — Q-S.. 



'o J o 

In particular, the quadratic covariation between Z and B is well defined Vh~ q-s. and has 
a density process T: 

d<Z,B) t = T t d(B) t = T t a t dt, P H - q. B .. (3.8) 

For any y G R and Z G SM^(R d ), let Y := Y y ' Z € S|-(R) denote the controlled process 
defined by the following ODE (with random coefficients): 

Y t = y - [ H s {Y s ,Z s ,F s )ds+ [ Z s odB s 
Jo Jo 

= y + J o (^a s :T s -H s (Y s ,Z s ,T s )\ds + Z s dB s , te[0,l], V H - q.s., (3.9) 

where o denotes the Stratonovich stochastic integral. We note that the wellposedness of 
(|3.9|) follows directly from the assumptions that T G G h (Dh), Z is square integrable under 
each P G Vh, and H is uniformly Lipschitz continuous in (y, z). 

Let £ G L°(R). Following Soner and Touzi [22] we introduce the second order stochastic 
target problem: 

V(0 := inf jy : Yf Z > £, P H - q.s. for some Z G <£M^(R d )} . (3.10) 
3.3 Relaxations 

We relax the target problem (|3.10p by removing the constraint that Z is a semimartingale. 
For any y G R, Z G W 2 H (R d ), f G G 2 H (D H ), and F G Pu, let Y := Y P '^> F G S 2 (P,R) 
denote the unique solution of: 

Y t = y + J^ (^a 8 :T s -H s (Y a ,Z a ,T 8 ) y jds + J Z s dB s , t € [0,1], P-a.s.. (3.11) 

Here, we observe that the stochastic integral J* * Z s dB s may not have a Vh~ q-s. version, in 
general, and thus we can only define (|3.1ip under each P G Vh- 
Our relaxed target problem is 

V(C) := inf jy : 3(Z,f) G EI^(R d ) x G 2 h (Dh) such that (3.12) 
jrP ll /,z,r > £ p _ a. s . f or a ii p G J. 
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The main duality result of this paper relies on the following further relaxation of the 
above target problems. For y G R, 2 G M 2 H (R d ) and P G Ph, let Y := F p * z G § 2 (P,R) be 
the unique solution of: 

ft = y+ f F s (Y s ,Z s )ds + [ Z s dB s , tG [0,1], P-a.s., (3.13) 
Jo Jo 

where existence and uniqueness of Y" follows from (|3.5p and (|3.6p . Here, again, the stochastic 
integral J" * Z s dB s may not have a T 7 //— q.s. version. Our further relaxed second order target 
problem does not involve the processes T and f, and is defined by: 

V(0 := inf {y : 3Z G FJ^(R d ) s.t. ff* 2 > £, P - a.s. for all P G P H } . (3.14) 

3.4 Dual formulation 

By (|2.5p . each P G C satisfies the martingale representation property. Let r be 
an F— stopping time and n an J 7 ,-— measurable and P— square integrable random variable. 
By (|3.5p . (|3.6p . and the standard BSDE theory, the following BSDE has a unique solution 

(y p (T,ri) t Z v (T,rf)) G S 2 (P,R) x H 2 (P,R d ): 

yf(r, v)=*-[ F s (y!(r, V ), Z*(t, r,))ds - f Z*{r, V )dB s , P - a.s. (3.15) 

Now for any £ G L^R), our dual formulation is: 

v(0 := sup % P (1,6- (3.16) 

¥&V H 

By the Blumenthal zero-one law (|2.5p . we know ^q(1,£) is a constant, and thus u(£) is 
deterministic. 

Our main focus of this paper is to provide conditions which guarantee that the problems 
V(£), V(£), and agree. In order to connect these problems to V(£), we will need an 
appropriate reformulation, see Section 

3.5 Some preliminary results 

In this subsection, we prove a straightforward string of inequalities. 

Proposition 3.7 Let Assumptions \3. il and [3J% hold true. Then, for any £ G L^R), 

V(0 > V(0 = V(0 > u(£). (3.17) 
Proof, (i) The first inequality holds true by definition of V and V. 
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(ii) To prove that V(£) > V(£), let y G R, Z G H^(R rf ) and T G G 2 H (D H ) be such that 
Y^' y,Z,r > £, P-a.s. for all P € "P^. By the definition of the conjugate function F: 

^a s : f s - H s (y, 2 S , f s ) < F s (y, 2 S ) for all y G R. 

By the comparison theorem for ODEs, we conclude that Y{' y ' ' < Y{' y,A , P-a.s.. Thus 
f*,v,2 > £ jP _ a _ s _ and therefore y > V(f). 

(iii) Similarly, to see that V(£) > V(£), we consider some y > V(£) so that there exists 
2 G (R d ) such that 

£ V,VZ > £ p _ a for aU F( z Vh . 

Then, for any e > 0, it follows from the lower-semicontinuity of H in 7 that there exists a 
progressively measurable process f G H (.D#) such that: 

-e< -6:f -H(f,2,f) <P(f,2} . 

Then, f G & h (Dh) and it follows from classical estimates on ODEs that there exists a 
constant C such that, with y := y + Ce, we have: 

yW,y,Z,t > f P, y f > ^ ^ for ^ p £ ^ 

Hence y > V(£). Since e > and y > V(£) are arbitrary, we conclude that V(£) > V(£). 

(iv) The final inequality V(£) > v(£) can be proved similarly to (ii) above by using the 
comparison theorem for BSDEs. □ 

Remark 3.8 Consider the Markovian case Ht(y, z, 7) = h(t, Bt, y, z, 7) and £ = g{B\), for 
some deterministic functions h, g. Assume in addition that the PDE (jl.4p has a solution 
u G C 1 ' 2 with appropriate growth. Then, by the classical verification argument of stochastic 
control, one can prove that u(0, 0) = Moreover, if H is convex, then it follows from 

a direct application of Ito's formula that u(0, 0) = V(£) = V(£) = If in addition 

{Du(t, B t ), t G [0, 1]} G SM H {R d ), then we also have u(0, 0) = V(f) = V(f ) = V(£) = u(f )■ 
Finally, any optimal P* (if exists) for the problem satisfies: 

-ot : D 2 u(t,B t ) - H. (-,u,Du,D 2 u) (t,B t ) = F. (-,u,Du,a.) (t,B t ), P* - a.s.. 

□ 

In the non-Markovian case, we shall prove in the next section our main duality result 
V(£) = D(£) = and that the optimal (Z,f), 2, for the problems V(£) and V(£), 
respectively, exist. However, we are not able to prove V(£) = V(£) in general. In order to 
obtain a result of this type, we shall introduce a slight modification of these problems by 
restricting P to smaller sets, see Section [5] below. 
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4 The main results 



This section is devoted to the proof of reverse inequalities. 
4.1 Conditional expectation 

We first establish a dynamic programming principle to prove our duality result V(£) = v(£). 
The understanding of the regular conditional probability distributions (r.c.p.d.) is crucial for 
this result. Indeed, let P be an arbitrary probability measure on Q and r be an F— stopping 
time. By Stroock and Varadhan [26J, there exists a r.c.p.d. P^ 1 for all uj G 0, satisfying: 

- For each uj G f2, P^ is a probability measure on T\; 

- For each E € J~i, the mapping uj — > P^(i?) is J>— measurable; 

- For P— a.e. w G f2, P£" is the conditional probability measure of P on J>, i.e., for every 
bounded J-'i-measurable random variable £ we have 

E p (£|JV)M=E p "(0, P-a.s.; 

- For each uj G f2, 

P£(fi£) = l where fi^^= {a/ G : a/(s) = co(s), < s < r(w)}. (4.1) 

The goal of this subsection is to understand P^ for P G Vu- Roughly, we shall prove 
that P^ satisfies the properties of Definition 13.31 on a shifted space, see Lemma 14.31 below. 
To do that, we introduce some notations. 

- For < t < 1, denote by 0* := {uj G C([t, l],R d ) : uj{t) = 0} the shifted canonical 
space; B 1 the shifted canonical process on Q*; Pq the shifted Wiener measure; F* the shifted 
filtration generated by B l . 

- For < s < t < 1 and uj G S1 s , define the shifted path 6 fi*: 

uj\ := UJ r — for all r G [t, 1]; 

- For < s < t < 1 and uj G S1 s , uj G $7*, define the concatenation path w ®t a) G fi s by: 

(w (8) t uj){r) := w r l[ gjf )(r) + (w t + w r )l[ t)1] (r) for all re[s,l]. 

- For < s < i < 1 and an J-*— measurable random variable £ on Q s , for each w E fi s , 
define the shifted T\— measurable random variable £* ,aJ on fi* by: 

^(w) := £(w ® t uj) for all w G 0*. 

Similarly, for an ¥ s — progressively measurable process X on [s, 1] and (t, w) G [s, 1] x f2 s , 
the shifted process {Xr,r G [t,l]} is F* —progressively measurable. 
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- For F— stopping time r, we shall simplify the notations as follows: 

LU (X> T iO .— CO W T ( W \ U), t, •— ? j A ' . — A 

The r.c.p.d. induces naturally a probability measure P T ' W on J 7 ^^ such that the 
P T ' W -distribution of B T ^ is equal to the P^ -distribution of {B t - B T ^,t G [r(w), 1]}. By 
(|4,1|) . it is clear that for every bounded and J-\ -measurable random variable £, 

E p "[£] = E P ^[£^]. (4.2) 

We shall also call P r ' w the r.c.p.d. of P. 

For < t < 1, following the same arguments as in Section [2] but restricting to the canon- 
ical space Q*, we may define martingale measures P*' a for each F*— progressively measurable 

-valued process a such that J. \a r \dr < oo, P — a.s.. Let Vg denote the set of all such 
measures P*' a . Similarly we may define the density process a* of the quadratic variation 
process (B l ). 

We first have the following result. 

Lemma 4.1 Let P G V s and r be an F— stopping time. Then, for P—a.e. lo £ P r,w G 
and 

a T s > u {Cj) = a T s iu,) (Cb) fords x dP T ^ - a.e. (s,w) G [r(w),l] x fT^, (4.3) 

where the left side above is the shifted process of original density process a on £1 = £Iq and 
the right side is the density process on the shifted space O" 7 "^ . 

Proof. The proof of P r,w G Vg^ is relegated to the Appendix. We now prove (|4.3|) . 

Since d(B. - B T ) t = d t dt, P-a.s. then d{B. - B r ) t = d t dt, P^-a.s. for P-a.e. u € ft. 
Note that, for each u G f2 and t > t(u), 

This implies that d(B r{uj) ) t = d^ w dt, P T - w -a.s. for P-a.e. uj G Q. Now (JOJ) follows from 
the definition of a 1 "^ . □ 
We next study the r.c.p.d. for P G Vh- For each (t,ui) G [0, 1] x O, let 

fl2- w (w,i/,z,7) :=lT a (w® t w,y,z,7), Fl> w (u,y, z) := F s {u ® t u, y, z, o*(w)), (4.4) 

for all (s,u)) G [t, 1] x f2* and (y, 2,7) eRxl^x _D#. We emphasize that in the definition 
of F t,u we use the density process d* in the shifted space. This is important in (|4.5[) below. 
However, by Lemma 14.11 we actually have, 

Ft ,UJ (u),y, z) = F s (uj ® t &, y, z, ds W (u))) = F s (uj ® t u),y, z), 
ds x dP^-a.e. (s,u>) G [t, 1] x O*, P-a.e. w£fl. 
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Since H and F are uniformly continuous in oj under the L°°-norm, by Assumption 13.11 and 
(13.21). we also have 



H s ,ul (oj,y, z,j) and F s ' u (£j,y, z) are uniformly continuous in oj under the L°° norm. (4.5) 

We remark that F s (oj <S>t oj, y, z, ds' w (o))) is in general not continuous in oj because a is not 
continuous in w, in general, see Lemma 12.21 Similarly, As a consequence of (|4.5|) . we see 
that for any P* G P^: 



E 



y (|I# W (0)| 2 + |Pj' w (0)| 2 ) < oo for some oj G iff it holds for all oj e Q. (4.6) 



We now extend Definition 13.31 to the shifted space. 

Definition 4.2 Let Vjj denote the collection of all those P £ P5 suc/i f/mf 

a P < a* < op, rfs x (ff - a.e. on [i, 1] x 0* /or some a P , ap € 
y (|iT* ,a, (0)| 2 + |F S *' W (0)| 2 ) (is < oo /or aZZ or, equivalently, some oj G ft. 



E- 

Then we have 



(4.7) 



Lemma 4.3 Lei Assumption \3.1\ hold true. Then, for any F— stopping time r and P G Vh, 
the r.c.p.d. P T > W G P^ (w) , forF-a.e. wGd. 

Proo/. Let P = P° G P// C P<?. By LemmaOwe have P T ' W G P^, P-a.s. By ([331) and 



33]) . it holds for P-a.e. oj G Q that 

a P < al'^ioj) < a P , ds x dP T ' w - a.e. (s,w) G [r(w), 1] x ft r(w) 



E 



r(w) 



F s (w ® T w,0,0,op w (w))| 2 + |if s (u; T w, 0,0,0) | 2 ) c?s 



< oo. 



This, together with (|4.3|) and (|4.4|) . implies (|4.7p . and thus completes the proof. □ 
We remark that in this paper we actually use the r.c.p.d. only on deterministic times. 
However, the r.c.p.d. on stopping times will be important in our accompanying paper |25j . 

4.2 The duality result 

To establish our main duality result, we need the following assumption on the terminal 
data. 

Assumption 4.4 £ is uniformly continuous in oj under the L°° — norm. 
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Under Assumptions 13,11 and 14,41 there exists a modulus of continuity function p for £ and 
H in lo. Then, for any < t < s < 1, (y, z) E [0, 1] x R x R d , and u,u' E O, w E O*, 

|^(£)_^'(o>)| <p(|| W - W '|| t ) and |F^(LD,y,z)-F^'(cD,y,z)| < p(|| W - 

where ||o;||t := sup 0<s<4 |w s |, < t < 1. We next define for all u; E fi: 

A(w):= sup A t (w) where A t (w) := sup (Vh^ 2 + /" ^(Ojpdsl Y . (4.8) 

0<<<1 PG-p^ V L Jt V 

By (|4.5p and following the same arguments as for (|4.6p . we have 

A(w) < oo for some ui E ^ iff it holds for all (4-9) 

Moreover, when A is finite, it is uniformly continuous in oj under the L°°— norm and is 
therefore J 7 !— measurable. 
Our main duality result is: 

Theorem 4.5 Let Assumptions lff.il \3.2k hold, and assume further that 

E P [|A| 2 ] < oo for all P E V H . (4.10) 

Then V(£) = V(£) = v(£), and existence holds for the problem V(£). Moreover, if F has a 
progressively measurable optimizer, existence also holds for the problem V(£). 

We first provide several examples that satisfy the hypothesis of the theorem and then 
prove it in the subsection! 



4.3 Examples 

Example 1 Linear generator. Assume that H is linear in 7: 

H t {y,z,j) = ft(y,z) + -a t aj:-f, 

where f t (y,z) and a t satisfy appropriate conditions for our assumptions to hold. Notice 
that the domain of F is reduced to a one-point set: 

F t (y,z,a) = f t (y,z)l {a=ata T } + ool {a ^ ata T } . 

Then, the present formulation of the second order target problem is clearly equivalent to 
the classical formulation under the reference measure P CT<T which ignores any uncertainty 
on the diffusion coefficient. □ 
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Example 2 Uncertain volatility models. Set H t (y,z,j) := G{^f) := ^[cr 2 7 + — ci 2 7~], where 
<7 > a > 0. This is the context studied by Denis and Martini [8j. By straightforward 
calculation, we find dom(F t ) = [ct 2 ,ct 2 ], and for any a G [<I 2 ,<7 2 ], F(a) = 0. It is easily 
seen that all our assumptions are satisfied. Moreover, we have V(£) = V(£) = P G (£) for 
appropriate random variable £, where E G is the G— expectation defined in Peng |19| . More 
connections between this paper and G— martingales are established in our accompanying 
paper [21]. □ 

Example 3 Hedging under gamma constraints. Let T, T > be two given constants. The 
problem of superhedging under Gamma constraint as introduced in |20j , [6] , and |21| , corre- 
sponds to the specification H s (y,z, r y) = H(j) = \a 2 ^ for 7 G [— T, V], and +00 otherwise. 
By straightforward calculation, we see that F(a) = \ (r(a — o~ 2 ) + + T_(a — o~ 2 )~). If both 
bounds are finite, the domain of the dual function F is the non-negative real line. The dual 
formulation of this paper coincides with that of |21j . □ 

4.4 Proof of the duality result 

The rest of this section is devoted to the proof of Theorem 14.51 From now on, we shall 
always assume Assumptions 13. l\ \'S.2\ 14.41 and that (|4.1U|) hold. In particular, we notice that 
(p~TUj) and flM]) imply that 

A t {u) < 00 for all {t,u) G [0, 1] x fl. (4.11) 

To prove the theorem, we define the following value process Vt pathwise: 

V t (u) := sup jf'*'" (1,0, for all (t,co) G [0, 1] x Q, (4.12) 

where, for any (ti,u) G [0, 1] x O, P G t 2 G [h,l], and any n G L 2 (P, F t2 ), we denote 
yf; tuU1 (t2,v) ■= Vt? 1 '", where i s the solution to the following BSDE on the 

shifted space fi* 1 under P: 

y F, tl ,u = rfuu _ J* 2 pt } ,u, (^vm^^vm^ dr _ J t2 z f,ti,^dBl\ s G [ti, t%], P — a.s.. (4.13) 

In view of the Blumenthal zero-one law (|2.5p . yf '^"(l, £) is constant for any given (t,u) 
and P G V\r. Moreover, since loq = for all w G fl, it is clear that, for the y v defined in 
(13T51) . 

y v <°>"(t, ?? ) = y v ( t , n) and F (w) = v(0, for all we!!. 

Lemma 4.6 Assume all the conditions in Theorem \4 ■ 5\ hold. Then for all (t,u) G [0, 1] xfl, 
we have \V t (u))\ < Ck t (uj). Moreover, for all (t,u),u)') G [0,1] x Q 2 , \V t (u>) - V t {u)')\ < 
Cp(\\co — u/||t). Consequently, Vt is Ft — measurable for every t G [0, 1]. 
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Proof, (i) For each (t,u) G [0, 1] x tt and P £ P^, on [t, 1] we have 
-l r- rl 



y s = ? 



dr 



where 7,77 are bounded, thanks to (|3.6p . Define 

M s := exp ( - J rjrdBl - J [ 7r + i|(a*)2^| 2 ]dr) . 
Applying Ito's formula we obtain: 



zf'^dB*., P-a.s. 



(4.14) 



Vt = M tVt = m tC ' 



t,U! 



*t.UJ 



Jt 



a.s. 



Thus 

1%" I 



E 1 



*t,u> / ji/f rnt.ui 1 



M T C'" - / M s i^(0)cis 



< 



E 



sup M s [|£*> u, | + f |F*' w (0)|cfal 

t<s<T Jt 



sup |M S | 

t<s<T 



E 



ie t,u, r+ / i^wi^s 



Since 7, ry are bounded, by standard arguments we see that 



Since P € V l H is arbitrary, we get |Vf(a;)| < Ck t {uj). 

(ii) Similarly, for (t,u,u') G [0, 1] x ft 2 and P G V l H , denote 



<j y : = y r >^ - , : = - z r ^ , 5£ := - f , 5F:=F 

Then, for s G [t, 1], |<J£| + 1^1 < Cp(||w - u/|| t ) and 

fiVa = S£- [ [5F r tf'^ t %6y r + 6zr&)zif?]dr- f Sz r dBl, 



a.s. 



where 7, are bounded, thanks to (|3.6p again. Define M as in (|4.14p but corresponding 
to (7,7/). Then following the arguments in (i) we obtain \5yt\ < Cp(||u; — Since P is 

arbitrary, we prove the lemma. □ 

The following dynamic programming principle plays a central role in our analysis. 
Proposition 4.7 Assume all the conditions in Theorem \4-5\hold. Then 



V h (u) = sup yj'* 1 '" (t 2 , V£*) , for all0<t 1 <t 2 <l and u G 0. 
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Proof. To simplify the presentation, we assume without loss of generality that t\ = and 
t<i=t. That is, we shall prove 



v(0= sup y%(t,V t ). (4.15) 



Denote (/,z p ) := (^(1,0,^(1,0)- 
(i) For any P G Vh-, note that 



y P = yf- f F r {f r y r )dr- f £dB r , se[0,t], P-a.s. 

By Lemma 14.31 for P— a.e. w G f2, the r.c.p.d. F t,UJ G T 7 ^. Since solutions of BSDEs can be 
constructed via Picard iteration, one can easily check that 



y f(uj) = yf '"'^(l.f), for P- a.e. we!]. (4.16) 

Then by the definition of Vt we get 

y?M < V^(w), for P - a.e. w G 0. (4.17) 

It follows from the comparison principle for BSDEs that y p < ^ p (t, Vt). Since P G Vh is 
arbitrary, this shows that v(£) < suppg-p^ 3^ p (t, Vt). 

(ii) It remains to prove the other inequality. Fix P G Vh and arbitrary e > 0. Since is 
separable, there exists a partition E\ G Tt^i = 1, 2, ■•• such that \\u — u'\\t < £ for any i 
and any u, u' G For each i, fix an G and let P£ G 7-^ be an e-optimizer of Vt (&i), 
i.e. K t (wi) <y^ UM + e. 

For each n > 1, define P n := ¥ n ' £ by: 

n 

P n {E) := E p [^E p *[(l i; )'^]l^] + P(£ n E?) where £ t n = U i>n £?. (4.18) 



That is, P n = P on T u and its r.c.p.d. (P™)*^ = Pj for w G E\, 1 < i < n, and (P™)*^ = P*> w 
for w G -E™. We claim that 

P n G V H - (4.19) 

The proof is similar to Lemmas 14.11 and 14.31 and thus is also postponed to Appendix. 
Now for 1 < i < n and to G El , by Lemma 14.61 and its proof we see that 

V t {u) < Vt(Lji) + Cp(s)<yp' tA (l,0 + s + Cp(e) 

< yp^(U) + E + Cp( E ) = yP^^{l^)+e + C P {e). 
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Here as usual the constant C varies from line to line. Then it follows from (|4.16p that 

V t < yT +e + Cp(s), P n - a.s. on U™ =1 E\. (4.20) 
Let (y n ,z n ) := (y n ' £ ,z n ' £ ) denote the solution to the following BSDE on [Q,t\: 



V? +e + Cp{s)] l ur , E i + Vflfr - f F r (y?, z?)dr - ! z?dB r 

- 1 Js J s 



a.s.. 



By the comparison principle of BSDEs we know y^it, Vt) < y$- Since 
have 



on J>, we 



pm mm 



F r (yF ,^T)dr - [ z^"dB r , se[0,t], P - a.s. 



Vs =Vt ' 

By the standard arguments in BSDE theory we get 

|tf - yT\ 2 < CE^[\e + Cp(e)f + \V t - yfl 2 ^' • 
By Lemma 14.61 and its proof we have \Vt\ < CAt and \yf \ < CAt, P— a.s. Then 

yZ(t,V t )<y$ < yr + C(e + p(e)) + c(E ¥ [\A t \ 2 l^]Y 
< v(0 + C(e + P (e)) + C (E F [\A t \ 2 l U ~ 



Recall (I4.10|) and notice that | 0. By sending n — > oo and applying the dominated 
convergence theorem we get 

3^o (*, V t ) < v(0 + C{e + p(e)), for all P € Vh- 
Since e > is arbitrary, we complete the proof. □ 

We next introduce the right limit of the V which is defined for each (t, uj) and is clearly 
F + — progressively measurable: 



lim V r - 



reQn(t,l],r^t 

Lemma 4.8 Assume all the conditions in Theorem\J.5\ hold. Then 



reQn(t,l],rii 
Proof. For each P € Vh, denote 



lim V r , Vh — Q-s. and thus V + is cddldg Vh — Q-s. 



(4.21) 



V-y p (l,0- 
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Then Vf > 0, P-a.s. For any < h < t 2 < 1, let (y p >* 2 , z F ' t2 ) := {y p {t 2 ,V t2 ),Z p (t 2 ,V t2 )). 
Note that 3>£(t 2 ,Ki)(£«0 = ^J* 1 ^^, ^ ,w ) for P-a.s. w. Then by Proposition O we get 
V£i > yf;* 2 , P-a.s. Notice that /- 1 = /. Denote 

~P,t 2 P,*2 P ~P,*2 --1/2/ P,t 2 P\ 

y 4 2 :=%' 2 -y t; V := a t (z t ' 2 - z t ). 
Then > y P '* 2 , P-a.s. and (/-' 2 , z P '* 2 ) satisfies the following BSDE on [0,i 2 ]: 

VV 2 = V% - f fl(//*,z^)ds - f 2 z^dWf, P - a.s. 
Jt Jt 

where 

ff(u,y,z) := F t {oj,y + yf(u;),d; 1/2 (u;)(z + zf(u;))) - F t {u,y^u),a/' 2 {u:)z r t {u)). 

Notice that / p (0,0) = 0, and / p is uniformly Lipschitz continuous in (y,z). Following 
the definition in [17] and j5], V ¥ is a weak / p — supermartingale under P. Now apply the 
downcrossing inequality Theorem 6 of [5], one can easily see that, for P— a.e. cj, the limit 
lim re Q n ( t)1 i ^ Vr(aj) exists for all t G [0, 1]. Note that y ¥ is continuous, P— a.s. We get that 
the lim in the definition of V + is in fact the lim, P— a.s. Then, 

V t + = lim V r , i £ [0,1], and therefore V + is cadlag, Vh — q-s. 

r€Qn(t,l],rit 

□ 

We are now ready to prove our main duality result. 
Proof of Theorem \4-5\ We proceed in several steps. 

Step 1. We first show that V + is a strong F— supermartingale under each P € Vh- For any 
P € V H , denote V + ' V := V + - /. Given < t x < t 2 < 1, Let £ Q n {t 1 ,t 2 ],r l n | t x and 
r^GQfl (t 2 , l],r% | £ 2 . We have VK > jLf™, P— a.s. for any m,n > 1. Send Ji-^cowe 

get > y£ m , P-a.s. for any m > 1. Send m — > oo, by the stability of BSDEs we get 

V t +' V > yJ' P '' 2 , P-a.s. where 

yt' v ^ = v t + / - f 2 f*M**X**)d* - f ~zp P > t2 dw!, P - a.s. 

Jt Jt 
That is, V +,¥ is also a weak / p — supermartingale under P. Apply Theorem 7 of [5], y +,p is 

p 

a strong / — supermartingale under P. That is, recalling (|2.5p . for any F —stopping times 
t\,t 2 with ri < r 2 , we have V-f ,¥ > ^' P ' T2 , P— a.s. where 

^• P ' T2 = V;t' P - I" fI(yt' T ' T \~zt' P ' T2 )ds- Hzt^dW!, tE[0,r 2 ], P-a.s. 
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This implies that V+ > y+/' T2 , P-a.s. where y+' P ' T2 := y+' P ' T2 + yf, z+' P ' T2 := a t /2 (~z+> p > T2 + 
zf) satisfy 



yp' 2 =V T t- F s (y:> r > T2 ,zp r ' T2 )ds- ~zp^dB s , P-a.s. 
Jt Jt 

That is, V + is a strong F— supermartingale under P. 

Step 2. For each P £ Vh, apply the nonlinear Doob-Meyer decomposition in |17j . there 
exist unique (P-a.s.) processes Z ¥ £ H 2 (P,P d ) and ET P £ I 2 (P,R) such that 

V t + = V + + f F S (V S + , Zf )ds + f 2fdB s -Kf, < t < 1, P - a.s. (4.22) 
Jo Jo 

Remark 14 . 91 b elow provides a simpler argument for this result. By Karandikar [13j, since V + 
is a cadlag semimartingale under each P £ Vh, we can define uniquely a universal process 
2 by d(V+, B) t = 2 t d(B) t , so that 2 = 2 F , dt x dP-a.s. for all P £ V H - Thus we have 

y+ = V + + / F S (F+, f s )ds + f 2 s dB s -Kf, < t < 1, P - a.s. for all P £ 7>h {4.23) 

.Step 5. We remark that V + is J 7 ^— measurable and is not a constant in general. For each 
P £ Vh C Vs, and each r £ Q n (0, 1], we have V$ > y P ' r , where 7/ P,r is a constant, thanks 

IP T" -4- 

to the Blumenthal zero-one law (I2.5P under P. It is clear that lim r |oyo' = i > P — a - s - 
Then Vo > V + , P— a.s. for all P £ "P//. Now by the comparison of ODE and recalling 
([343]) and (jOgj) . we see that ff " 2 > f^ ,Z > V"+ = £, P-a.s. for all P £ Vh- Now 
by the definition of V(£), we get V(£) < Vo = f(£). This, together with (I3.17|) . proves 
V(Q = V(Q = v (0- Moreover, the process 2 in (I4.23P is clearly the optimal control for the 
problem V(£). Finally, when F has a progressively measurable optimizer, the existence of 
the optimal control for the problem V(£) is obvious. □ 

Remark 4.9 Following a suggestion of Nicole El Karoui, we derive the decomposition 
(|4.22p by the following alternative argument. Consider the following reflected BSDE: 

f fr = i-!lF s {Yf,2f)ds-HzfdB s + Kl-Kj, 

\ Yf > V t + , [Yl - V+]dKf = 0. " " ' 

By Lepeltier and Xu |14| . the above RBSDE has a unique solution and Y F is cadlag. Then 
it suffices to show that Y F = V~ + , P— a.s.. In fact, if they are not equal, without loss of 
generality we assume Yq P > V + . For each e > 0, denote r e := inf{t : Yf < V t + + e}. Then 
t £ is an F P — stopping time and Yf_ > V£t + e > V^L for all t < t £ . Then Kf = 0, t < t £ , 
and thus 



fr = fz - r mr, zf)ds - r 2f dBs 

Jt Jt 
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Note that Yf < + e, by comparison theorem for BSDEs and following standard argu- 
ments we have Yq < yo~' P ' re + Ce < Vq + Ce. Since e is arbitrary, this contradicts with 
fi > V+. □ 

We conclude this section by establishing a representation formula for V + , which will be 
important for our accompanying paper [25]. For each P G Vh and t G [0, 1], denote 

V H (t,F) := {¥' G V H ■ P' = P on F t } and V H (t+,F) := {¥' GP/j:P' = Pon F?}. (4.24) 

Then we have 

Proposition 4.10 Assume all the conditions in Theorem \4-5\ hold. Then, for each P G T^jf, 
V$= ess sup p yf (1,0 and V t + = ess sup p yf (1, £), W - a.s. 

Proof. Fix P G Vh- Denote 

Vf:= essBup p }f (1,0 and Vf + := ess sup p yf (1, £) 

P'ev H (t,v) f'ev H {t+,P) 

(i) We first prove the equality for V. For each P' G Ph(£,P) C Ph, by (|4.17p we have 
yf < P'-a.s. Since P' = P on T u then yf < V t , P-a.s. and thus Vf < V t , P-a.s. 

On the other hand, proceeding as in step (ii) of the proof of Proposition 14.71 we define 
P n for each n,e by (|Q5]I . By ([435]) . it is clear that P n G V H (t,F). Then it follows from 
(B~20l) that 

V[V t <V t v + e + Cp{e)} >F[V t < yf + e + Cp(e)] > P[Ui<;< n £*] -+ 1, as n oo. 

That is, V t < Vf + e + Cp{e), P-a.s. for all e > 0. This implies that V t < Vf, P-a.s. 

(ii) We now prove the equality for V + . First, for each P' G 'P#(i+,P) C Vh and 
r G Q n (t, 1], we have yf < P'-a.s. Send r I t, we obtain < V t + , P'-a.s. Since 
both yf and Vf~ are J-"f— measurable and P' = P on J-^ , then yf < V t + , P— a.s. and thus 
Vf ,+ < 14, P-a.s. 

On the other hand, for each r G Q fl (t, 1], since 14 = T4 P , P— a.s. Following the same 
arguments in |25j Theorem 4.3 Step (iii) (we emphasize that there is no danger of cycle 
proof here!), we have 

there exist P n G V(r,F) such that y? n (l,0tV r , P-a.s. (4.25) 

Then, it follows from the stability of BSDEs that 

yf(r,V r ) = yf(r, lim = ton tf(r,tf»(l,0) ■ 
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Since P n € V(r,F) C V(t+,F), we have 

yf(r,V r ) = lim yf n (r,y^(l,0) = Hm 3f tt (l,0 < Vf' + , P — a.s. 



Send r 4- £, by the stability of BSDEs again we obtain V t + < V t ' , P— a.s. □ 
After the completion of this paper, Marcel Nutz provides us the following result which 
shows that, under our conditions that F and £ are uniformly continuous in u>, actually 
V + = V. However, we decide to keep our original arguments because they are applicable to 
more general cases, for example, the case in Section [5] where we do not require the uniform 
continuity of F and £. 



Proposition 4.11 (M. Nutz) Assume all the conditions in Theorem \4-5\ hold. Then V t = 
V t , V H -q.s. 

Proof. First, by Lemma 14.61 V + is uniformly continuous in uj with the same modulus of 
continuity function p. Since V + is F + — progressively measurable, for any 5 > 0, we have 
\V t + (u)-V t + (uj')\ <Cp(\\u-uj'\\ t+ s). Send ,5 ^ we get \V t + {uj) -V t + (u/)\ < C p(\\w - u/\\ t ) 
and thus V + is F— progressively measurable. 

By Proposition I4.10| it is clear that < Vt, Vh— Q-S. On the other hand, for any 
P G V H and P' G V H (t,F), by the second equality of Proposition [OH we have yf (1,0 < 
V^ + , P'— a.s. Since both sides of above are T%— measurable and P' = P on Ft, we have 
yfO-,0 < V t + , P-a.s. Then the first equality of Proposition EED] implies that V t < V t + 
P— a.s. Therefore, V + = V, Vff—q.s. □ 



5 A weaker version of the second order target problem 

The purpose of this section is to suggest a slight modification of the second order stochastic 
target problem so that its value is not affected by the relaxations of Section 13.31 The key 
tool for this is the aggregation approach developed in our accompanying paper [23]. The 
idea is to restrict our attention to an (uncountable) subset of Vh, constructed out of a 
countable subset, so that a dominating measure is available. 

As a consequence of this modified setup, we shall remove the continuity assumption on 
£. However, we still assume the nonlinearity H satisfies Assumption 13. 11 in particular, H is 
uniformly continuous in u and the domain Dp t of its convex conjugate F is deterministic, 
see Section [H] for the general case. 

5.1 The dominating probability measure P 

Throughout this section we fix a countable subset To C [0, 1] containing the end-points 
{0,1}, together with a countable sequence Aq := {a l ,i > 1} of deterministic integrable 
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mappings a 1 : [0, 1] —> satisfying the concatenation property: 

a { l m + a j l [tA] G Aq for all i,j > l,t G T , (5.1) 

Note that a 1 is deterministic, then by Lemma E21 a = a\ P a -a.s., and thus Ao is a gener- 
ating class of diffusion coefficients in the sense of Definition 4.7 in [23J. Following Definition 
4.8 in [23], let A be the separable class of diffusion coefficients generated by (Aq,Tq). Fol- 
lowing Proposition 8.3 in [23], let V(A) C Vs denote the corresponding measures. Then, 
by Definition 4.8 in [23], 

oo oo 

PeV(A) if and only if a = J2 "^^[m.rn+i)' IP - a.s. (5.2) 

n=0 i=l 

for some 

• sequence of F— stopping times {r n ,n > 0} with values in To, with tq = 0, r n < T n+ i 
on {r n < 1}, and inf{n : r n = 1} < oo, 

• and some partition {E™ ,i > 1} C T Tn of 0. 

Finally, we assume P' := P Ql G V H and denote T>£ := V(A) n V H - 
The dominating measure is now defined by 

oo 

p ._ F A),To ._ ^2"*!*. (5.3) 
i=l 

Clearly P is a dominating measure of {P*,i > 1}. By Proposition 4.11 in [23], P is in fact a 
dominating measure of V(A), and thus of Vjj. Therefore, V^— q.s. reduces to P— a.s.. 

5.2 The second order target problem under P 

Recall the spaces defined in (|3.7|) . Let Lq(D) := P| i>;L L 2 (P 4 , T>), and define the spaces 
Mq(D), Oq(D), Sg(.D), %(D), Gq(Dh), and SM 2 Q {R d ) similarly. 

Now for an .7-1— measurable r.v. £, the modified second order target problem under P is: 
V (0 := inf \y G R : Y?' Z > £, P - a.s. for some Z G <SMo(R d )} > ( 5 - 4 ) 

where G S§(R) is defined by except that V H —q.s. is replaced with P— a.s. (or 

equivalently, Pjfj— q.s.) 

Next, notice that the families of processes {Y F \i > 1} and {Y r ,i > 1}, defined by 
(|3.1ip and ()3.13j) respectively, can be aggregated into processes Y and Y, thanks to Theorem 
5.1 in |23] , We then define the following relaxations of ()5.4p : 

V (0 := inf \y : Yf Z ' r > £, P - a.s. for some (Z,T) G H§(R d ) x , (5.5) 

Vo(0 := inf jy : Yf Z > P - a.s. for some Z G H§(R d )} . (5.6) 
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Finally, our modified dual formulation under P is: 



vq(£) ■= sup 3#(U), (5-7) 

where is defined by means of the BSDE (|3.15p . Similar to (|3.17p . it is obvious that 

V (0 > V (0 = V (£) > MO- (5.8) 
5.3 The main results 

In the present modified setting, we have the equality between the second order target 
problem and its first relaxation. For this, the following technical condition is needed. 

Assumption 5.1 For any e > 0, there is an ¥ -progressively measurable e—maximizer 7 e := 
7t (y, z) of \3. 1\) such that, for every 5 > 0, 

\lt{y,z)\ < C e7 s(l + \y\ + \z\) , P- a.s. on {a t > did}, for some C £i s > 0. 

Similar to (14.8ft . for each % > 1, define 



A* := ess surF K\, K\ := ess sup p ( E t 

o<t<i Pe-p^(t,P 4 ) 



\i\ 2 + /V.(o)| 2 



(5.9) 



where, as in Proposition 14.10] 

Pff(t,F) :={Pe^:P = P 1 on T t }. (5.10) 

Theorem 5.2 Xei Assumptions \3. f[ \3.2\ and \5.1\ hold true. Assume further that 

E r [|Ai 2 ] < oo, for alli> 1. (5.11) 

Then for any £ G Lq(R), we Ziave Vo(£) = Vo(£) = Vo(£) = ^o(£)> anc ^ existence holds for 
the problem Vo(0- Moreover, if F has a progressively measurable optimizer, existence also 
holds for the problem Vo(£). 

This main result Vo(£) = Vo(£) wm be proved in next subsection. The equality Vo(£) = 
Vo(£) was already stated in (|5.8p . The remaining statements are analogous to the proof of 
Theorem 14.51 We thus omit the proof and only comment on it: 

• we first define for every i > 1 the dynamic problem: 

VI := ess sup r (5.12) 

Pe'P^(t ) P i ) 
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where y ¥ is defined by means of the BSDE (13351) and Vfi{t,W' 1 ) is given in (|5.10p . In 
light of Proposition 14.101 this is the analogue of the process V in f)3. lOj) , except that 
this is defined P*— a.s. for every % > 1. However, using the aggregation Theorem 5.1 in 
[23J, we can aggregate the family {V l ,i > 1} into a universal process V, i.e. V = V 1 , 
P'-a.s. for all i > 1. 

• Combining the arguments of Lemma 7.2 in |23j and Proposition 14.71 we have the 
dynamic programming principle: 

V tl = ess sup r yft(t 2 , V t2 ), r - a.s. for all t > 1. 

• Exploiting the connection with reflected BSDEs, we then obtain the decomposition 
([4.23P under each P l , and we conclude by the definition of the problem Vo(£). 

Our final result shows that, except for the initial second order target problem, under 
certain conditions all other problems are not altered by the modification of this section: 

Theorem 5.3 Let Assumptions \3. f[ \3.2l \4-4\ hold, and assume further that 

- F is uniformly continuous in a for a € Dp t} and for all (t,0J,y,z) and all a 6 -DiV 

< C(l + ||o;||i) and \F t (u,y,z,a)\ < C(l + ||w|| t + \y\ + \z\ + |a 1/2 |), (5.13) 

- Vjj is dense in Vh in the sense that for any P = P a £ Vh and any e > 0: 

E Po [ C \{a £ t ) 1/2 - a t /2 \ 2 dt] < e for some F £ = P a " € Vfi. (5.14) 
Jo 

Then vq(£) = v(£) and thus Vq(£) is independent from the choice of the sets Ao and Tq. 
Assume further that Assumption \5. 1\ and (|4.1U|) hold. Then 

v (0 = MO = vb(0 = MO = <0 = v(0 = v(0- 

Proof. By (|3.17|) . Theorems 14.51 and I5.2( clearly it suffices to prove the first statement. 
Since Vjj C Vh, we have vq{0 < v(£). Now for any P = P a S Vh an d any e > 0, let 
W = P° e e Vfi satisfy (|534]) . Recall the W ¥ defined in $T2}). Notice that 

Yf = £(B.) + f F s (B.,Yj, Z*, a s )ds - f Zfa^ 2 dWf, < t < 1, P - a.s. 
Jt Jt 

Let (Y ¥ , Z ¥ ) denote the solution to the following BSDE under Po: 

Yf = i{X a ) + / F s (X a , Yf, Zl , a s )ds - / Z ¥ s a x J 2 dB s , < t < 1, P - a.s., 
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By Lemma 12.21 the P— distribution of is equal to the Po— distribution of . This, 
together with the Blumenthal zero-one law, implies that Yq = Yq. Similarly, Yq E = Yq £ , 
where (Yq € , Zq e ) is the solution of: 

Y* e =£(X?) + / F 8 (X a \Yr,Zr,a e 8 )ds- f ^ (a^ 2 dB s , < t < 1, P -a.s., 
Jt Jt 

By Proposition 2.1 from El Karoui, Peng and Quenez |1U| . we deduce that 



\ I o ~ x o I — \ 1 ~ r I 



< CK 
By (|5.13p we have 



JO 



2 

(it 



|£(X q£ )! <C||X ae ||i <C||X Q ||i + C||X a -X Q£ || 1 ; 
|-F t (A. , F t ,Z 4 ,a t )| < G(J|A || t + \Y t | + |Z t | + \a t \ 1 

< c( n^iix + |F t p | + \zf\ + H 1 / 2 ) + c( \\x aE - X a \\, + |af - a^ 2 



It follows from iOi| that E p » [ sup < t <i \X? - Xf\ 2 ] < e. Then \i(X a ")\ 2 is uniformly 
integrable under Po and \F t (X aS ,Yf , Zf, a\ )| 2 is uniformly integrable under dt x cffV Now 
by the uniform continuity of £ and F we get lim £ _>o l^cf — = 0- This implies that 
^ P < y o(£) for all P £ Vh: and therefore, u(£) < v (£). □ 

A sufficient condition for the uniform continuity of F in terms of a is that Dh is bounded. 
We next provide a sufficient condition for the density condition (|5.14p . 

Proposition 5.4 Let Assumption \3.1\ hold and suppose that the domain Dp of F is inde- 
pendent of t. Assume further that Tq is dense in [0, 1], and there exists a countable dense 
subset A C Dp such that, for all a € A, the constant mapping a is in A . Then Vfi is 
dense in Vh in the sense of (|5.14p . 

Proof, (i) We first prove that P a € for any a taking the following form: 

There exist = to < ■ ■ ■ < t n = 1 in To and a finite subset A n C A s.t. 

n-l (5.15) 
a = J2i=o a t ! 1 [i„i,+i) + "in 1 ^} and ol takes values in A n . 

In fact, since A n C is finite, then a has both lower (away from 0) and upper bounds, 
and thus P a is well defined. Using the notations in Lemma 12. 2\ we set a := a o /3 a . 



Clearly a = ^27=0 a U^-[u,u +1 ) + a t n ^-{t n } an d a also takes values in A n . By Lemma [2? 
we know a = a, dt x d¥ a — a.s. and P a satisfies (|3.4p . Then it follows from (|5.2p that 
P a £ V(A). Moreover, by numerating A n = {a l ,i = , n}, we have a = Y17=i a ' l ^-E i , 
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where E{ := {oj : at{uj) = a 1 , < t < 1}, i = 1, • • • , n, form a partition of T\. By Lemma 
5.2 in [23], we know P" = P a ' on E u i.e. ¥ a (E n £<) = P al (£ n Efc) for all £ € 7i. Since 
each P q1 € Vjj satisfies (|3.5j) . then so does P a . This implies that P a € "Ph, and therefore, 
P a G 7*$. 

(ii) Now fix P a G Pif. Since a G £>f, x dF a -a.s. by Lemma Owe know a G L>f, 
(it x cIFq— a.s. For any e > 0, since E Po [J |at| 2 c?t] < oo, by standard arguments there 
exists F— progressive measurable cadlag process a e such that a £ takes values in Dp and 
E p °[ Jo | (ctf ) 1 / 2 - (a t ) l l 2 \ 2 dt\ < e. Now by the dense property of T and A, there exists 
of in the form flEQfl such that E p ° [/J l(af) 1 / 2 - (of )V2|2<fi] < e. Then E Po [/J l(af) 1 / 2 - 
(at) 1 / 2 ! 2 ^] < Ce. Since P q£ G "P^ by the above (i), the proof is complete. □ 

5.4 Proof of Theorem Q (V (0 = V (0) 

The proof requires the following extension of Bank and Baum pQ to the nonlinear case. 



Lemma 5.5 Let ht(ui,x,z) : [0,1] xfixRxR^-jik ¥— progressively measurable, 

l 2 (R d ), 



uniformly Lipschitz continuous in (x,z), and h(0, 0) G Hq(M). For a process Z G T°' 2n ' : '' ! ' 



let X z G §o(P) denote the aggregating process of the solutions to the following ODE (with 
random coefficients) under each P\' 

Xf = x+ [ h s (X z ,Z s )ds + [ Z s dB s , < t < 1, F - a.s. 
Jo Jo 

Then for any £ > 0, there exists Z e G Ho(P rf ) with finite variation, P— a.s. such that 

sup \Xf -X t z \ < e, P- a.s. 

0<t<l 

Proof. Recall ()3.4p . For i > 1, let C{ = Ci(a P i,a P i) > 1 be some constants which will be 
specified later. Note that ([33D implies a x l 2 Z G M 2 (P i , R d ). Define P := YaLi v ^\ where 
v\ := 1 - ]T°^2 f» > 0, and 



f' 1 

1 + E*{ sup |Xf| 2 + / [|^| 2 + |a t 1/2 Z 4 [ 2 + [^(0,0)| 2 ]dAl, for*>2. (5.16) 
^ o<t<i Jo J J 



Then P is probability measure equivalent to P, P* < v- 1 P, and 

X Z GS 2 (P,P), and Z, a 1/2 Z G M 2 (P, R d ). (5.17) 
Obviously it suffices to find Z £ G H 2 (P,M) such that 

Z e has finite variation and sup \Xf — X z \ < e, P — a.s. 

0<t<l 
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1. Denote X := X z . As in Bank and Baum [T], we first prove that, for any F— stopping 
time t and any X T ,Z T € L 2 (P, Jy), there exists a process Z £ > T e HI 2 (P,R d ) such that 
Zp T = Z T , Z £,T is absolutely continuous in t with finite variation on [r, 1], and 



L(t-r)| X e,r _ X t \> e + \X T - X T \ 



sup e K v t 

T<t<l 



< £ 



where L is the uniform Lipschitz constant of h with respect to x, and 

X e t ' T = X T + [ h s (X £ s ' T , Z £ s ' T )ds + / Z £ s ' T dB s , t>r, P-a.s. 



(5.18) 



(5.19) 



For simplicity we assume r = and X T = x,Z T = z. Set Zt := z for t < 0, and define 
J?" := n f+_i Z s ds for every n > 1. Then Zq = z, Z n is continuous in t with finite variation, 

n 

and, by (pUTj) . 



lim A|Zf - Z 4 | 2 + |a, 1/2 (Zf - ^)| 2 ]<it} 

n— >oo L Jq J 



0. 



Let X™ and X be defined by Aq = Xq = x and: 

dX™ = ^(A t n , Z?)dt + Z?dB t , dX t = h t (X t , Z t )dt + Z t dB t . 
By the Lipschitz property of h, it follows from standard estimates on SDEs that 



lim E 

n— too 



\ sup 

L 0<t<l 



\X? - X t \ 2 dt} = and e~ Lt \X t - X t \ < \x - x\ 



Then, for any e > 0, 



sup e~ u \Xt - X t \ > e + \x - x\ 

0<t<l 



< 
< 



sup e~ Lt \X? - X t \ > e 

0<t<l 



sup \X? -X t \ > e 

0<t<l 



0, as n — > oo. 



By setting Z £ ' T := Z n for n large enough so that the above probability is less than e, we 
complete the proof of (|5.18|) . By our construction, notice that 



Z e ^ E L 2 (P, T T i ) for every F— stopping time t > r. 



(5.20) 



2. In this step, we construct a sequence of F— stopping times (rj)j>o which yields the 
required approximation (X £ ,Z £ ). We initialize our construction by To := 0, Xq = Xq and 
Zq arbitrary. Let e > be fixed, and set e n := 2~ n e~ L e. 

Assume Tj is defined and (X £ ,Z £ ) have been defined over [0, Tj] with Z £ . S L 2 (P, T n ). 
By (|5.18p there exists Z l+l 6 H 2 (P, M. d ) which is absolutely continuous in t and has finite 
variation on [rj, 1] such that Z^ = Z £ . and 



»{ sup e- L (*- Tl )|A t i+1 -X, 



i+l) 
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where {X'i +1 ,t G [t u 1]} is the solution of the ODE (pU9l) with initial condition X l + l = X £ .. 
Denote 



t 1+1 := 1 A inf {* > n : e- L{t - T ^\Xl +1 - X t \ = e i+l + \X £ n - X n \} , 



and define 



Xf:=Xl + \ Z?:=Z! + \ Vi G (r h r i+1 ]. 



i+1 



In particular, it follows from flOD]) that G L 2 (P, J* Ti+1 ). 

We remark that, although the filtration F is not right continuous, since X' l t +l — X t is 
continuous, the Tj + i defined here is an F— stopping time. Since Yli=i ^( r « < 1) — e « < 
1, it follows from the Borel-Cantelli Lemma that P(r, < l,Vi) = 0. That is, (X s , Z £ ) is 
well-defined on [0, 1] and Z e is absolutely continuous in t and has finite variation on [0,1]. 
Moreover, for t G [r^Tj+i], 

sup e-^-^Xf - X t \ < e i+1 + \X £ n -X n \. 



n<t<T i+ i 



Then 



sup e~ Lt \Xf - X t \ < e- LT >s l+1 + e~ L ^ \X E n - X n \ < e i+l + e~ Lr * \X £ n - X T 

Ti<t<T i+1 



By induction one can easily see that sup e Lt \Xf — X t \ < e, = e L e, and then: 



0<t<l 



sup \X £ — X t \ < £, 
0<t<l 



a.s. 



3. It remains to check that Z £ G H 2 (P,M d ). For any i, j > 1, note that 

ft.OXJ, 2£)ds - ( 3 Z £ s dB s , t<Tj, ¥ ' 



Xt = x £ 



a.s. 



By the Lipschitz continuity of h and (|3.4|) . and following standard arguments one can easily 
see that, for some constant Cj > 1: 



\Z £ t \ 2 dt 



< CiW 

< c-e 1 



X £ Tj \ 2 + I ' \ht(0,0)\ 2 dt 



sup \X t \ 2 + e 2 + I \h t 

0<t<l 



(0,0)| 2 <ft}, 



for all j > 1. 



Set Cj in (|5.16p to be the above constant Cj. Then by sending j — > oo, we get 



E 



\Z £ \ 2 dt 



< for alH > 2. 
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Then 

E p J [\Zf\ 2 dt\ = J2 ^ [ j \Zt\ 2 dt] < ^iE pl [ J \Zt\ 2 dt] + ^ < 00. 
This completes the proof. □ 

Proof of Theorem \5.2\ (Vo(£) = Vo(£) )■ In view of (|5.8p . we only need to show that Vo(£) < 
"P (£) when P (0 < 00. For any e > 0, there exist y < %{£) + e and 2 G EI§(M d ) such that 
the corresponding := Y^ > £, P-a.s. Set y := y + e and Z := Z. By Assumption EH 
we may find f G Go(-Djf) n H^Dh) such that the corresponding Y x := Y?' Z ' F > £, P-a.s. 
Denote for i G [0, 1]: 

■— f r ATI /-. ■— 7. — 7° v0 — f vOjn v. ■— V. _ 



Z t u := / T s di? s , Ct := Z t " Yt ■= / X t := Y t - T t 

'0 Jo 



and 



/i t (u;, x, 2) := ~at(w) : r t (w) - H t (u, x + Y t °(a;), 2 + Z^(uj),T t (uj)). 

One easily checks that h satisfies the conditions of Lemma 15.51 and X = X^. Then, there 
exists £ e G Sg(M d ) with finite variation over [0, 1] so that: 

sup \Xf -X t \<e, P-a.s. 

0<t<l 

Set Z £ := C + Z°, Y £ := X? + Y°, and observe that d(Z £ , B) t = d(Z°, B) t = T t dt, P-a.s. 

... ... 2 

Therefore, Z e G SM {R d ). Setting y := y, one can easily check that Y £ satisfies A3. Ill) for 
given (y,Z £ ,T). Notice that fj3. 1 1 f) coincides with (13. 9ft for given f, we have Y £ = Y y,ZE . 
Then 

Y v,z £ _ Y = x^ -X and thus sup \Y t y ' Z£ -Y t \<e, P - a.s. 

0<t<l 

Let L denote the Lipschitz constant of H with respect to y, and set y £ := y + e e. Then 

yV.^ _ Y t y > zs = e L e + f X s {Yf^ - Y^) ds, 

Jo 

where |A S | < L. This leads to Yf' Z£ - Yf Z " = e L ee& Xtdt > £ , and thus: 

Yf' Z£ > Y^ ZE + e>Y 1 >£, P - a.s. 

Therefore V (0 < V + e L e < y + (1 + e L )e < V (£) + (2 + e L )e. Since e is arbitrary, this 
provides the required result. □ 
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6 Extension 



In this section we extend our setting in Section [3] by considering V s instead of Vh and by 
removing the constraints on the domains of H and F. In view of the length of this paper, 
we shall only formulate the extended problems heuristically and will not report the details. 
However, all the results in this paper can be extended to this new setting. 

Let H t (oj, y, z,j) : [0, 1] x Q x E x M. d x R dxd ->1U {oo} be a measurable mapping, and 



F t (oJ,y,z,a) := sup j -a : 7 - H t (w,y, z, 7) 1 , oeS] 



>0 



be the corresponding conjugate with respect to 7 which takes values in RU{oo}. We assume 
Dfj t , the domain of H in 7, is independent of (y, z) and contains 0, H is uniformly Lipschitz 
continuous in (y,z) and lower-semicontinuous in 7 for all 7 G Dn t , and F is mesaurable. 
Then the domain Dp t of F in a is also independent of (y, z), and i 7 is uniformly Lipschitz 
continuous in (y, z), for all a G -Df 4 - 

Recall the notation Pf := F t (0,0), and define the increasing sequence of F— stopping 
times 

t n := 1 Ainf It > : / A°ds > ral , n > 1; and f := lim f n . (6.1) 
I Jo J n ^°° 



Notice that 



/ F s °ds < 00 on I) {t n = 1} and f F°ds = 00 on P| {f n < 1}. (6.2) 
J n>l ^ n>l 



We shall assume further that 



F°| 2 d S 







< 00 for all P G Vs and n > 1. 



For the present extended setting, we introduce the space L 2 (R) := n pg p s I/(P,lR), together 
with 



f| H 2 oc (P,R d ) := P| (~] [Z : Z1 [oa j G H 2 (P,R d )}, 
G 2 H (D H ) := Q G L(P^H) 

: = Q H{ r: (^:r-^(o,o,r))i [0 , fn] GH 2 (P,R)}, 

and the corresponding spaces for continuous processes (resp. semimartingales) : X E 
S 2 (R) :=_n Pe p s §L( P > ffi ) (^p. 5M 2 (M d ) := DlPe^s S^LC^^)) iff for every n > 1 
and P G P s , X Afn G § 2 (P,R) (resp. £M 2 (P, R d )). 
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Now given £ G L 2 (IR), the second order stochastic target problem is defined by 
V(0 := inf jy : Yf' Z > £, P 5 - q.s. for some Z G &M 2 (M d )} , 
where Y := Y 2 '' 2 G §> 2 (M) is defined by the following ODE (with random coefficients): 

Y t = y- I H s (Y s ,Z s ,T s )ds+ f Z s odB s , t < f, V S - q.s. 
Jo Jo 

Yi- := lim Yf n on I J {f n = 1}, Y t : = oo for t G [f, 1] on Pi {f n < 1}. 

n>l n>l 

Similarly, the extended relaxed problems are: 

V(0 ■= inf {y : 3(Z,f) G H 2 (M d ) x G 2 H {D H ) s.t. Y^'^ > £,P-a.s. for all P G V s ] , 
V(0 := inf jy : 3Z G H 2 (M d ) s.t. Y 1 P,y,z > f, P - a.s. for all P G P 5 } , 

where Y p := Y p >^- f and Y p := Y p >^ are defined by 
ft /i \ 



Y p = y + ^ Qr s :a s -# s (Yf,Z s ,r s )^ <fa + Z s dS s , t < f , P - a.s. 
Y? := lim Y? on I) {f n = 1}, Y p := oo for t G [f , 1] on Pi {f n < 1}; 

n>l n>l 

Y p = y+ / F s (Y s F ,Z s )ds+ [ Z s dB s , t < f, P - a.s. 



o 



(6.3) 



Y? := lim Y? on M {f n = 1}, Y p := oo for t G [f , 1] on f| {f n < 1}. 

n>l n>l 

Finally, we remark that P[U n {f n = 1}] = 1 for all P G Vh- The dual formulation in 
this extended setting is the same as the original v(£) defined in (13. 16ft . That is, for dual 
formulation we still use Vh, instead of Vs- Under certain technical conditions, again we 
can show that V(£) = V(£) = v(£). Moreover, if we extend the weaker version in Section [5] 
analogously, similar results will still hold. 



7 Appendix 

In this Appendix we prove Lemmas 14.11 and Claim (|4.19|) . We shall use the notations of 
Lemma 12.21 

Proof of Lemma\Jl\(F T > u} G V^)- Let P = F a G V s be given. We emphasize that we shall 
consider both the strong formulation (B,X a ) under Po and the weak formulation (W V ,B) 
under P. We prove the lemma in four steps. 

Step 1. We first proceed in the strong formulation. Let f be an arbitrary F— stopping 
time. We claim that 

(P ) f ' w = P^ for P - a.e. well. (7.1) 
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Since \a s (oj)\ds < oo, P — a.s. clearly J~/ u \ \al' u (u)\ds < oo for P — a - e - oj € £1 and 



i.e. Q € fFK Then 



v**" G pJM for Fq _ a e w G a 



(7.2) 



We now prove (|7.1|) . which amounts to say, for Po-a.e. w, 

E p o'" [f] = E p o M [£], for any bounded J 7 ^^ -measurable r.v. £. (7.3) 
By standard approximating arguments, it suffices to prove (j7.3j) by assuming 



, where B T t ^ := u t l[Q tT ( u ))(t) + [w r ( w ) + £j (w) ]l [T ( w ) )T ] 



for all rational < ii < • • • < t n < T and Ai, ■ ■ ■ , A n € Q d . By the countability of rational 
numbers, we may allow the exceptional Po-null set to depend on £. Moreover, by backward 
induction, we may assume without loss of generality that n = 1 and t n = T. That is, we 
want to prove, for any A € Q d , 



r(u) 



Note that 



E p o 



t(w) 



e AB T 



e 2 



for Po-a.e. w, 



(7.4) 



-[T-t(w)] 



Then, by (14.21) and the definition of r.c.p.d., (I7.4h is equivalent to 



E 



e X[B T -B T ] 1h 



E^ 



g 2 I- 'Jjy, 



[T-7 



where ^ := <p(B SlM , • • • , B SmAt ), (7.5) 



for any < si < • • • < s m < T and any bounded and smooth function ip. 

To see (|7.5p . we first assume r takes only finitely many values, and by otherwise merging 
the partition points, we assume without loss of generality that r takes only values s%, ■ ■ ■ ,s m . 
Then, noting that B. — B Si is a Brownian motion under Pq, 



E LH 



i=\ 
m 

^EPorEPo^A^-B.]!^^^^^ 



^ E Mef(^), 8i l {T=Si} 



i=l 



E^ 



|AJ! 

e 2 ' J ?7 



[T-r] 



In the general case, we may find stopping times r„ |r such that each r n takes finitely many 
values. Then 



\[B T -B T 



E ff 



e —l T Tn]^ 
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Send n — > oo, and note that ry is continuous in t, then by the Dominated Convergence 
Theorem we obtain (|7.5j) . and hence prove (|7.ip . 



Step 2. We construct the r.c.p.d. for P in weak formulation. Define 

f:= T oX a and a T ^ := a f > Mu)) . 



(7.6) 



One can easily see that f is also an F— stopping time. By the definition of ¥ a and the 
definition of the mapping j3 a in Lemma 12.21 we have r = f o /3 a , P a — a.s. Then it follows 
from (O) that 



G V 



-(«) 



for P a - a.e. w£(l, 



(7.7) 



Siep 3. We show that P T > W = P Q ' for P-a.e. w G 0, by assuming the following claim 
which will be proved in Step 4 below: 



E 



<p(B tl Ar,--- ,B tnAT )ip(B tl ,--- ,B tn ) 



E 



ip(B tlAT , ■ ■ ■ ,B tnAr )ip T 



(7.8) 



for any < ii < • • • < t n < 1 and bounded and continuous functions <p, ip, where, 

^r(w) :=E par " [^(w(ti),-- - ,w(t fc ),w(*) + B| fc+1 ,-- - ,w(t) + B^) 
for f := t(w) € [t k ,t k+1 ). 

Indeed, if (|7.8p is true, then by the arbitrariness of p and (t±, ■ ■ ■ ,t n ), it follows from 
the definition of r.c.p.d. that, for P a — a.e. to G $7 and for t := r(to) G [tfcjtfc+i)> 



(7.9) 



We remark that the exceptional P Q — null set is supposed to depend on tp and t\ < • • • < t n . 
However, by standard approximating arguments, one can easily choose a common null 
set. That is, there exists a P Q — null set Eq such that, for any to ^ Eq, (|7.9p holds for all 
(ti, ■■■ ,t n ) and all bounded continuous function ip. This clearly implies that, for to £ Eq, 

E p ' [rj] = E p [rj\ for all bounded and J 7 ^^ — measurable random variable r\. 

Then P T ' W = P 5 "'", for P-a.e. to G O. This, together with ([777]) . proves that P r ' w G T 7 ^, 
for P-a.e. cj G £1 

5£ep ^. We now prove (|7.8]h For i := t(cj) G ifc+i), by definition of P qT '" we have 



tp T (u>) 



E r o 



[•tn . 

to(t) + / (a f / a ^)*dB T s ^) 
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Then, for each oj £ f2, when t := t(w) = r(X a (w)) G [ifc, ifc+i) ? 



^( W ),..,^( W ) 1 X t » + 



note that (P ) T ' W -distribution of (B f M,at' u (B f W) is equal to the (P )£ -distribution of 
(2?. — Bf(w)) Oi T,UJ (B. — Bff u \)). Recall (I7.ip . and note that, for each w£fl, 



Then 



tk+i 



MX a (oj)) = EW^(X«(a;),--- ,X? k (u>),X?(u) + J (a s )l{B.)dB s , ■ ■ ■ ., 

+ y {a s )*(B.)dB s ) 



Then 



E r 
E Po 

E pa 



<p(B tlAT , ■ ■ ■ ,B tnAT )ip T 
<p(B tlA T,--- ,B tnAT )4)(B tl , ■ ■ ■ ,B tn ) 



j T 



This proves (|7.8|) and hence the lemma. 

Proof of Claim (IOTP . Let P = P a and Pj 
Define 



for appropriate a and a 1 , i = 1, 



a s := a 



n 

.■l[o,t)(^)+[E^ 1 ^( XQ ) + Q! - 1 4«( Xa )] 1 [*4]( s )- 



i=l 



□ 



,n. 



Following similar arguments as in the proof of (|7.8p . one can easily show that, for any 
0<ti<---<£fc = t< tk+i < ■ • • <tn and any bounded continuous functions (p and 



E 



i=l 



,B tk )ip(B tl , ■■■ ,B tn ) 
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Then P™ = P a and one sees immediately that P n € Vg- 

Moreover, since each ¥' l t satisfies (|4.7p . one can easily check that P n satisfies all the 
requirements in Definition 13.31 and thus P n € Vu . □ 

Acknowledgement. We are very grateful to an anonymous referee for his/her very careful 
reading of the original manuscript and many useful suggestions. 
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